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Assortment and the evolution of cooperation in a Moran 
process with exponential htness* 
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Abstract: We study the evolution of cooperation in a finite population interacting ac¬ 
cording to a simple model of like-with-like assortment. Evolution proceeds as a Moran 
process, and payoffs from the underlying cooperator-defector game are translated to pos¬ 
itive fitnesses by an exponential transformation. These evolutionary dynamics can arise, 
for example, in a nest-structured population with rare migration. The use of the exponen¬ 
tial transformation, rather than the usual linear one, is appropriate when interactions have 
multiplicative fitness effects, and allows for a tractable characterization of the effect of as¬ 
sortment on the evolution of cooperation. We define two senses in which a greater degree 
of assortment can favour the evolution of cooperation, the first stronger than the second: 
(i) greater assortment increases, at all population states, the probability that the number 
of cooperators increases, relative to the probability that the number of defectors increases; 
and (ii) greater assortment increases the fixation probability of cooperation, relative to 
that of defection. We show that, by the stronger definition, greater assortment favours 
the evolution of cooperation for a subset of cooperative dilemmas: prisoners’ dilemmas, 
snowdrift games, stag-hunt games, and some prisoners’ delight games. For other coopera¬ 
tive dilemmas, greater assortment favours cooperation by the weak definition, but not by 
the strong definition. Our results hold for any strength of selection. 
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1 Introduction 


Whether like-with-like assortment favours the evolution of cooperation is a critical ques¬ 
tion in social evolution and population biology more generally. Assortment can result if 
interactions are often between related individuals (e.g., if the population is ‘viscous’), or 
if individuals prefer to interact with those to whom they are similar (homophily). Any 
theoretical analysis of the relationship between assortment and cooperation requires the 
synthesis of two models; one for cooperative interactions, and one for population assort¬ 
ment. 

The simplest models of cooperation are games between two players, where each player 
has available to it the same two strategies: cooperate (C) and defect {D). The paradig¬ 


matic example is the prisoners’ dilemma (Rapoport and Chammah 1965 Axelrod 1984 


Nowak 2006b), but many other two-strategy games can be interpreted as cooperative 


dilemmas as well (Nowak 2012). 


A simple model of assortment in two-strategy games was developed by Grafen (1979). 
In his model, individuals can be of two types, corresponding to the two strategies in the 
underlying game. In a given time-step, an individual interacts with a same-type individual 
with probability r, and a random member of the population (possibly same-type, possibly 
not) with probability 1 — r. Higher values of r correspond to greater degrees of assortment 


in the population. This model has been extended in many ways (Eshel and Cavalli-Sforza 


1982; [Bergstrom 20031 

Jansen and Van Baalen 

2006 

van Veelen et al. 

2012 

Alger and 


Weibull 

2013 

Van Cleve and Akcay 

2014 

Allen and Nowak 

2015 


Does increased assortment tend to favour cooperation? Of course, this question is 
not new, and has been approached from numerous angles. Most analyses have been in 


a deterministic, infinite-population setting. In such a setting, Hamilton (1971, App. A) 
determines, for several particular games of interest, whether selection is in favour of cooper¬ 


ators or defectors in a population with an interaction structure identical to that in Grafen 


(1979). Extending this, Eshel and Gavalli-Sforza (1982) analyze the effect of Grafen’s 
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assortment parameter on the conditions for evolutionary stability of cooperation and de¬ 
fection. They show that, for cooperative dilemmas broadly defined (two cooperators do 
better than two defectors, and a defector does better than a cooperator when faced with 
a cooperator), there are threshold assortment levels 0 < r** < r* < 1 such that, if r > r*, 
cooperation is the only ESS, but if r < r**, defection is an ESS (and the only one in the 
case of a prisoners’ dilemma). That is, sufficiently high relatedness renders cooperation 
evolutionarily stable, while sufficiently low relatedness renders defection evolutionarily 
stable. 

More recently, the effect of assortment on the evolution of cooperation has been studied 
in the context of finite populations subject to stochastic evolution. In this setting, a natural 
measure of the success of a strategy is the weight of its pure state (where the population is 
monomorphic for that strategy) in the stationary distribution of the evolutionary process 
( Eudenberg and Imhof|[^006 Allen and Tarnita|2014 Veller and Hayward||2016 ). In a two- 
strategy game (such as the usual cooperative dilemmas) with symmetric, small mutation 
rates, the superiority of one strategy over the other corresponds to its having a higher 


hxation probability (Eudenberg and Imhof 2006; Allen and Tarnita 2014). In a very 
general model of social evolution that allows for arbitrary dependence of payoffs on strategy 


frequencies and population structure of any sort. Van Cleve (2015) derives, in the limit of 
weak selection, the conditions under which the fixation probability of cooperation exceeds 
that of defection. 

An alternative way to study whether assortment aids cooperation is to determine the 
effect on key parameters of the evolutionary process, positive or negative, of marginal 
changes in the assortment parameter. In the economics literature, this general approach 
is called ‘comparative statics’: rather than trying to determine the exact effect a change 
in one variable has on another, we instead try to determine just the direction of the 
effect (its ‘comparative static’). Many empirical studies of social evolution test the broad 
‘comparative statics’ statement that increased relatedness should be associated with more 


cooperation, and much of social evolutionary theory is interpreted in this way (Erank 
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2013). It is therefore important that the comparative statics of social evolution be studied 


extensively from a theoretical perspective. 


A step in this direction was recently provided by Allen and Nowak (2015), who stud¬ 


ied the effect of assortment on the evolution of cooperation in a finite population subject 
to Wright-Fisher evolution. Interaction each period accords with Grafen’s assortment 
process, with expected payoffs derived from an underlying two-strategy game. Expected 
payoffs are translated to fitnesses according to a linear mapping mediated by a selection 
strength parameter w, and the next period’s population composition is chosen stochasti¬ 


cally on the basis of these fitnesses. Allen and Nowak (2015) derive analytical results for 


the ‘weak selection limit’, re —?■ 0. In this limit, for most cooperative dilemmas, increasing 
relatedness favours cooperation in the sense that it increases the fixation probability of a 
single cooperator relative to that of a single defector. 

Here, we make use of a relatively recent advance in the study of finite-population 
evolutionary game theory to give a more general characterization of the comparative statics 


of assortment in Grafen’s model. We model evolution as a Moran process (Moran 1958), 


occurring in a finite population that interacts according to Grafen’s assortment model. 
Expected payoffs translate to fitnesses according to an exponential mapping mediated by 
a selection strength parameter w (Traulsen et al.||2008). With this setup, we can derive a 


more general result than Allen and Nowak (2015): for any selection strength w, increasing 


r increases the fixation probability of a cooperator relative to that of a defector for the 
same set of cooperative dilemmas to which their result applies. We also define a stronger 
sense in which increased r favours cooperation, and show that this too holds for a natural 
class of cooperative dilemmas: prisoners’ dilemmas, snowdrift games, stag-hunt games, 
and some prisoners’ delight games. To distinguish this stronger definition, we provide an 
example of a cooperative dilemma where assortment favours cooperation by the weaker 


definition of Allen and Nowak (2015), but not by our stronger definition. 


For most of this work, we follow in the footsteps of many others (fGrafen 1979; Eshel 


and Cavalli-Sforza|1982 Bergstrom|2003; [Jansen and Van Baalen|2006; [Alger and Weibull 
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2013; Van Cleve and Akcay|[2M4 Okasha and Martens||20i5 ) by treating r as an abstract 
assortment parameter without specifying how this assortment arises mechanistically. In 
Section however, we illustrate how our model could apply to a nest-structured pop¬ 
ulation. In this setting, the parameter r quantifies the frequency of interaction among 
nest-mates. 

Our results offer insights into the effect of assortment on the evolution of cooperation, 
and highlight the usefulness of the exponential fitness function in evolutionary game theory. 


2 The general model 

Social interactions are between two individuals, with the payoffs from any one interaction 
defined by the payoff matrix 



C 

D 

c 

R 

S 

D 

T 

P 


Following Nowak (2012), we say that the game is a ‘cooperative dilemma’ if R > P (two 
cooperators do better than two defectors) and at least one of the following conditions 
holds: (i) T > R (it is better to defect if one’s opponent cooperates), (ii) P > 5 (it 
is better to defect if one’s opponent defects), (iii) T > S' (if one interactant cooperates 
and the other defects, then the defector does better than the cooperator). The game is a 
prisoners’ dilemma if T > P > P > S; it is a snowdrift game if T > P > S > P; it is a 
stag-hunt game if P > P > P > S. 

The population is of constant size N. Each member’s type is either cooperator (plays 
C) or defector (plays D). Each period, each member of the population receives its expected 
payoff from the following interaction: with probability r, it interacts with an individual of 
the same type, and with probability 1 — r, it interacts with a random member of the pop¬ 
ulation, with each member equally likely (including the individual itself—the possibility 
of self-interaction simplifies the analysis). 

The population state at a given time is defined by the number of cooperators, i. If 
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1 < i < — 1, then the expected payoff to a cooperator and a defector are: 


7rf = rR+{l — r) 


= rP + (1 — 


iR + {N -i)S 
N ’ 
iT + {N -i)P 

' ' N 


(1) 


These expected payoffs in turn translate to (positive) fitnesses according to some mono¬ 
tonic transformation. 


Evolution is modelled as a Moran process (Moran 1958, Nowak 2006a). Each period, 


the fitnesses of the cooperators and defectors in the population are calculated as above. 
One member is chosen for reproduction; the probability of being chosen is proportional 
to fitness. One member of the population is chosen to die; each member is equally likely 
to be chosen. A new individual is then born, taking the place of the one chosen to die. 
The new individual is of the same type as its parent, the member chosen for reproduction 
(which can be the same as the individual that was chosen to die). 

Thus, if there are i cooperators this period in the population, with 1 < f < N — 1, then 
denoting by the probability that there will be j cooperators next period, we have: 


Pi,i+1 — 

Pi,i—l — 
Pi,i = 


ifi 


C 


N-i 

+ (iV-z)if ’ 
i_ {N-i)fP 
N i/f + (iV-i)/f ’ 

1 Pi,i+1 Pi,i—1- 


( 2 ) 


We term the ‘relative rate of increase of cooperation’ at population state i. 

This leads to our first definition by which higher assortment can favour cooperation: if it 
increases the relative rate of increase of cooperation for all interior i. 

Definition 1. Assortment favours cooperation in the strong sense if > 0 for all 

i = 1,..., N — 1. 

Notice that, given the Moran process transition probabilities in Pi,i+i/pi,i-i = 
ff / fP . So the condition for assortment to favour cooperation in the strong sense simplifies 
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to ^ > 0 for all i = 1,..., — 1. 

J i 

Now consider the probability that a single cooperator, presently in a population that 
is otherwise all defectors, takes over the population; i.e., its ‘fixation probability’, . For 


our frequency-dependent Moran process, this is given by (Nowak 2006a): 




-r-rj /P 


1 + E nil 


/■ 


The fixation probability of a single Z) in a population otherwise all-C is 


P^ = 


N-l /f 

'> t 


n'l^ 


i+E"vre=if' 


From these expressions, the ‘relative fixation probability of cooperation’, /p^, simplifies 
to: 


P 


i-D 


H/ 

1=1 •'* 


This leads to our second dehnition by which higher assortment can favour cooperation: if 
it increases the relative fixation probability of cooperation. 

Definition 2. Assortment favours cooperation in the weak sense if >0. 

The use of the terminology ‘weak’ and ‘strong’ for these definitions is justified by 

8 fP 

the fact that the strong definition implies the weak dehnition: if >0 for all i = 

J i 

1,..., - 1, then clearly ^ ju > 0- 


3 The exponential fitness transformation 


Following Blume (1993) and Traulsen et al. (2008), we use an exponential transformation 


of expected payoffs to (positive) htnesses: 


/f = exp (-WTrf), ff = exp (wTrf ), 


( 3 ) 
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where w is the strength of selection. We should note, as do Traulsen et al. (2008), that 


this choice of transformation is for the most part arbitrary. Any transformation should 
translate payoffs to fitnesses monotonically, and in such a way that the fitnesses are positive 
(since transition probabilities in the stochastic evolutionary process are proportional to 
them). In the common linear transformation, / = l+tcvr, when some payoffs are negative, 
the selection strength needs to be sufficiently small to ensure that all fitnesses are positive. 
In contrast, the exponential transformation that we use guarantees that all fitnesses are 
positive, even if some payoffs in the underlying game are negative. 

Moreover, the exponential transformation is more conducive to a ‘multiplicative fitness 
effects’ interpretation. If an individual has a total of K interactions, with each interaction 
k having a small fitness consequence exp {wtt ^/« I + /K, and if these fitness 

consequences combine multiplicatively, then the total fitness consequence is 


K 


K 


f = = exp j w—^r 


k=l 


k=l 


If the TT^ are interpreted as payoffs from an underlying game, then the expression above 
can be read as exp (wit), where vr is the average payoff to the individual. Treating averages 
as expectations, this is the same as the expression in ([^. 

Finally, we note that in the weak selection limit rc —>■ 0, the exponential fitness trans¬ 
formation coincides with the usual linear fitness transformation / = 1 -|- wit, since 
Taylor expanding ([^ around w = 0 gives exp (uj-tt) = 1 -|- wtt + 0{w'^). Thus, models 
that use the linear fitness transformation and the weak selection limit, such as in Allen 


and Nowak (2015) and Nowak et al. (2004), can be thought of as special cases of the 


exponential fitness formulation. 


4 Results for exponential fitness 

We now consider the effect of assortment on the evolution of cooperation when fitnesses 
are calculated according to ([^. The relative rate of increase of cooperation is calculated 
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by successively applying (§ and Q: 


Vi,i+\IVi,i-\ = /f//f = exp {w [vrf - vrf]), 


(4) 


with TTp and as specified in Q. 

This allows us to analyze for which games assortment favours cooperation in the strong 
sense of Definition 1 (Fig. 1): 

Proposition 1. Assortment favours cooperation in the strong sense if R> S and T > P, 
with at least one inequality strict. 

Proof. We have from 0 that 


d Pi. 


i+l 


d 


dr pi^i-i 


= exp {w [vrf - [ttP - vrf] , 


and since the exponential is positive, the sign of is the same as the sign of 

[ttP — Trf]. Writing x := i/N, so that x £ (0,1), we have from Q that this quan¬ 
tity is given by 


T^TTp — t^TtP = [i? — xR — (1 — x)S] — [P — xT — (1 — x)P] 
or or 

= {l-x){R-S) + x{T-P). 


(5) 


If both R> S and T > P, with at least one inequality strict, then Q is strictly positive for 
all x £ (0,1), and therefore for all i such that 1 < f — 1. So, therefore, is . □ 

Notice that the condition R > S and T > P provides a natural stringent definition 
of a cooperative game: No matter what my strategy is, I would prefer that my opponent 
cooperate. This condition is satisfied, in particular, by prisoners’ dilemmas {T > R > 
P > S), snowdrift games {T > R > S > P), and stag-hunt games {R > T > P > S). In 


fact, the only other cooperative dilemmas - as defined by Nowak (2012) and in Section 2 


- that satisfy this condition are those where R > T > S > P] i.e., a subset of “prisoners’ 
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\ Assortment favors * 
\ cooperation 
in weak 

sense 





Figure 1: A summary of our results for two-player games. Assortment favours cooperation 
in the strong sense (increases the relative rate of increase of cooperators for all intermediate 
population states) if R > S and T > P, with at least one inequality strict (blue and red 
cross-hatch). For large enough population sizes, this is a necessary condition as well. 
Assortment favours cooperation in the weak sense (increases the fixation probability of a 
single cooperator, relative to a single defector) if, and only if, R — S > P — T (blue). 


delight” games ( ]Binmor^|2004 Skyrms 2014). 

We can also prove a partial converse to Proposition 1, which shows that Proposition 
1 can be strengthened to an ‘if, and only if’ statement provided the population size N is 
sufficiently large. 


Proposition 2. If assortment favours cooperation in the strong sense, then one of the 
following three sets of conditions is satisfied: 

(2a) R> S and T > P, with at most one inequality strict. 

(2b) R> S,T <P, andN < 

(2c) R<S,T> P, andN < 

Proof. See Appendix A. □ 


We now determine how much broader the conditions are under which assortment 
favours cooperation in the weaker sense of Definition 2. 
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As noted by Traulsen et al. (2008), the ratio of fixation probabilities in the 

frequency-dependent Moran process simplifies significantly with the exponential fitness 
transformation (§: 


P 

P 


c 

D 


N-l 


n 


ii 

fF 


N-l 


n exp(n; [vrf-vrf]), 


exp 


N-l 



2 = 1 


( 6 ) 


But in our case, we have from ([^ that for each i, vrf -|- = 2rR -|- (1 — r)(i? -|- S) and 

TT^ + TiFi-i = 2rP -|- (1 — r)(r -|- P), and if N is even, then 7r^^2 = rR + {1 — r){R + S)/2 
and vr ^/2 ~ -|- (1 — r)(T -|- P)l2. Grouping payoff terms for i and — i in ([^, we see 

that, for both odd and even N, 


P 

P 


c 

D 


exp ^2 ^ [2rR + {1 — r){R + S) — 2rP — (1 — r){T + P)]^ 

exp -P + S-T) + r{R-P-S + P)]^ . (7) 


This allows us to analyze for which games assortment favours cooperation in the weak 
sense of Definition 2 (Fig. 1). 

Proposition 3. Assortment favours cooperation in the weak sense if, and only if, R — S > 
P-T. 


Proof. From (j^, we have that 

d 0^ f N -I \ N -I 

— ^ = exp f [(P -P + S-T)+r{R-P-S + T)]\ w^—{R -P-S + T). 


Since the exponential is positive, ^^>0 P — P — S'-|-r>0. 


□ 


This condition corresponds to that found by Allen and Nowak (2015) for assortment 
favouring cooperation in the same weak sense, but their result applies only in the weak 
selection limit (re —>■ 0), whereas our result holds for all selection strengths. 
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A corollary of Proposition 3 follows from a result due to Fudenberg and Imhof (2006). 


Consider an evolving finite population of cooperators and defectors, where cooperators 
mutate to defectors and defectors to cooperators at the same rate. If this rate of muta¬ 
tion is very small (the ‘weak mutation limit’), the long-run distribution of the (ergodic) 
evolutionary process over all population states i = 1 , 2 ,..., A" is close to a distribution 
over just the two pure states all-D {i = 0) and all-C (i = N). This distribution is 


given by 


p p 

p^+p^ ’ p^+p'- 


, whose dependence on can explicitly be seen in the form 

^ i+pCjpD 1 1 ~ • If greater assortment increases the ratio p^/p^ (i.e., if assort¬ 

ment favours cooperation in our weak sense), it also increases the weight on the cooperative 
state in this weak mutation limit. 


Corollary 1. In the Moran process with symmetric mutation rates, in the weak-mutation 
limit, greater assortment increases the stationary distribution’s weight on the cooperative 
state all-C if, and only if, R — P — S + T>0. 

If the condition R — P — S + T > 0 holds and mutations are very infrequent, then this 
corollary can be interpreted as follows: at a time point far in the future, a population with 
a high degree of assortment is more likely to be all cooperating than is a population with 
a low degree of assortment. Alternatively, among many evolving populations, cooperation 
will be more common among those with high assortment than those with low assortment. 

We have demonstrated that, for a large class of cooperative dilemmas, assortment 
favours cooperation in our strong sense, and that for an even broader class, assortment 
favours cooperation in the weak sense. To demonstrate the utility of the distinction 
between our weak and strong dehnitions, we provide an example of a game in which 
assortment favours cooperation in the weak sense but not the strong sense. 

Suppose we have a population of size A > 10 interacting according to Grafen’s assort- 
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merit model, with payoffs specified by the game 



C 

D 

c 

/? = 10 

5 = 1 

D 

II 

00 

P = 9 


This is a ‘cooperative dilemma’ in the sense of Nowak (2012) because two cooperators get 
a higher payoff than two defectors {R > P), it is better to be the defector in a cooperator- 
defector pair {T > S), and it is better to defect if one’s opponent is a defector {P > S). 

Here, assortment favours cooperation in the weak sense, because R—P—S+T = 8 > 0. 
But assortment does not favour cooperation in the strong sense, because none of the 
conditions (2a), (2b), and (2c) holds: (2a) and (2c) fail because T < P; (2b) fails because 
= 10 < iV. 


5 Realization of the model in a nest-structured population 

So far we have described the model in abstract terms. Here we show how the model can 
be realized in a nest-structured population, with r describing the relative frequency of 
interaction among nest-mates. 

Consider a population with N nests, each containing a single adult. Each time-step 
corresponds to a single (non-overlapping) generation. Each generation, each adult pro¬ 
duces a large number of juveniles. Each juvenile interacts with a large number of others, 
a proportion r of these being with juveniles from the same nest, and the remaining pro¬ 
portion 1 — r being with juveniles chosen uniformly from the population at large. These 
interactions determine a juvenile’s fitness multiplicatively, so that htness is an exponential 
function of the sum of individual payoffs. 

After interaction, a new head for each nest is chosen, forming the next generation of 
adults. With high probability (1 —/i, where /i <C 1 represents the migration rate) the new 
head of a nest is chosen from among the juveniles who were born at this nest. Otherwise 
(with probability the new head is chosen from the juvenile population at large. In each 
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case, the choice is made proportionally to fitness. 

In the limit /r —0, the dynamics of the above model coincide with those of the simple 
model we have studied in this paper (up to a rescaling of time). The reason is that, as the 
migration rate becomes very small, the probability of there being two migrants in a given 
generation becomes negligible compared to that of there being only one migrant. Thus at 
most one nest changes its strategy per generation, consistent with the Moran process. 

6 Games with more than two players 

In reality, many cooperative dilemmas are not pairwise interactions, but involve more 
than two players. Here, we shall demonstrate that our methodology can extend to a 
particularly simple n-player cooperative dilemma, a linear public goods game. We shall 
show that increased assortment favours the evolution of cooperation in this case. 

Interactions occur in groups of size n, where each interactant is either a cooperator (C) 
or a defector (D). Assortment is defined as r = P(C|C') — P(C|T)), where P(C'|T>) is the 
probability that a randomly chosen interactant of a defector is a cooperator, and P(C'|C') 
is the probability that a randomly chosen interactant of a cooperator is a cooperator 
2009| ). (It is easily seen that ¥{C\C) — ^((711?) = F{D\D) — F{D\C), so that 
this definition does not depend on the labelling of strategies.) This definition is consistent 
with that used in our two-player setup above. 

Assortment derives from a ‘population structure’, which determines, from the number 
of cooperators in the population, their distribution among the interacting groups. For¬ 
mally, in a population of size N, a population structure m (for ‘matching function’) is 
a vector-valued function that specifies, for each possible number i of cooperators in the 
population, a probability distribution (m[g](i), m[i](z),..., m[„](z)) over the n -|- 1 possible 
group compositions, so that m[j](z) is the probability that, when there are i cooperators 
in the whole population, a randomly chosen group contains exactly j cooperators. (The 
subscript in (i) is bracketed to distinguish that this is the number of cooperators in the 
group, while we have throughout used an unbracketed subscript to indicate the number 


(Van Veelen 
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of cooperators in the whole population. 


One complication arises. In an inhnite-population setting (Van Veelen 2011; Jensen 


and Rigos 2014 Rigos and Nax 2016), where the proportion x G [0,1] of cooperators 


is specified, it is required that the population structure /, applied to the proportion of 
cooperators x, recapitulate that proportion: x = our hnite-population 

case, where the law of large numbers does not apply, N/n groups drawn independently 
from the distribution m{i) need not contain a total of i cooperators. To sidestep this 
complication, we shall make an assumption analogous to that of self-interaction in the 
two-player game setup: interactants in a group are drawn with replacement from the 
population, according to the distribution m{i). That is, we shall assume that an individual 
can take on multiple positions in the group, so that a group of n need not contain n distinct 
individuals. 

We shall be interested in the population structures that maintain, for all intermediate 
f = 1, 2,..., N—1, a constant assortment parameter r. One such population structure, and 
a natural extension of the population structure we analyzed for two-player games, is this: A 
cooperator’s n—1 group-mates are, with probability r, all cooperators, and with probability 
1 — r are drawn randomly and independently from the population (i.e., they constitute 
a binomial sample of size n — 1). When there are no cooperators in the population 
(respectively, no defectors), then all groups comprise only defectors (respectively, only 
cooperators). The exact population structure that leads to a constant r will not matter 
in what follows, because the game we shall consider is linear. For general (nonlinear) 
n-player games, however, the population structure will matter. 

The game played by the n constituents of a group is a linear, or additive, public goods 
game. A cooperator produces, at individual payoff cost c to itself, a public good that 
provides benefit b to each member of the group. A defector enjoys the benefits of the 
public good produced by cooperators in the group, but does not produce any itself. The 
payoff to a cooperator in a group with j cooperators is = jb — c, while the payoff to 


a defector in a group with j cooperators is = jb. 
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The expected payoff to a cooperator and a defector are, respectively: 


vrf = -c + 6+(n-l)P(C|C)6; 
vrf = {n - l)¥{C\D)b. 


(8) 


With a constant-r assortment process and this game, when there are i cooperators in the 


population, we have (Van Veelen 2011): 


vrf -vrf = {n-l)[F{C\C)-F{C\D)]b-c + b= {n-l)rb-c + b. 


As before, we calculate fitness exponentially from expected payoffs, and update the 
population according to a Moran process. Checking our strong condition by which assort¬ 
ment favours cooperation. Definition 1: 

Pi,i+i/pi,i-i = ff= exp (tc[7rf - vrf ]) = exp {w[{n - l)rb -c + b]), 


so that 


d PiA 


i,i+l 


= w(n — l)6exp {w[{n — l)rb — c + 6]) > 0. 


dr pi^i-i 

Therefore, assortment favours the evolution of cooperation in the strong sense here. 

The above results apply to a linear public goods game. For nonlinear public goods 
games, a single assortment parameter does not suffice to characterize the effects of popula¬ 
tion structure on natural selection; rather, a full probability distribution over all possible 


group compositions is required (Van Veelen 2009 Ohtsuki 2014). Therefore, while non¬ 


linear public goods games are important from both a theoretical (Archetti and Scheming 


2012) and empirical (Gore et al. 2009) perspective, an analysis of how assortment affects 


cooperation in such games is beyond the scope of the current work. 


16 


















7 Discussion 


We have studied the effect of assortment on the evolution of cooperation, making use of a 
simple model of like-with-like assortment in two-strategy games. We have demonstrated 
that, for many cooperative games of interest (including prisoners’ dilemmas, snowdrift 
games, and stag-hunt games), increased assortment favours the evolution of cooperation 
in two senses: it increases the rate at which the cooperative strategy increases in the 
population, and it increases the fixation probability of cooperators relative to that of 
defectors. 


Most studies of stochastic game theory - for example, Allen and Nowak (2015) in a 
setting similar to ours - assume selection to be weak. This assumption is made because 
standard stochastic models are otherwise intractable, with analytical results impossible. 
Here, making use of an exponential transformation of payoffs to fitnesses instead of the 
usual linear one, we have demonstrated that informative analytical results may be obtained 
in the more general case allowing any strength of selection. 

Moreover, this exponential transformation is not simply a mathematical expediency. 
We have argued that it is the appropriate transformation of average payoff to fitness when 
fitness derives from many interactions with multiplicative fitness effects. Multiplicative 


fitness effects are a common assumption in population genetics (Ewens 2004), but not in 
evolutionary game theory, where additive fitness effects are standard. 

In addition to their biological import, our results highlight the usefulness of this expo¬ 


nential payoff-fitness transformation in the Moran process [also see Traulsen et al. (2008)], 
and suggest that tractable results could be obtained by using this as a model to answer 
other questions in social evolution and evolutionary game theory more broadly. 
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Appendix A: Proof of Proposition 2 

We prove Proposition 2 by considering all possible cases for the signs oi R — S and T — P. 
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From Proposition 3, we know that if P > T and R> S (with at least one inequality 

If P < 5 and T < P, both terms in ([^ are non-positive, and so < 0. 


• If P < S and T > P, the term P —S in ([^ is negative, and the term T — P is positive. 
The expression ([^ is therefore increasing in x := i/N, and therefore smallest when 
z = 1. So, in this case, > 0 for each i = 1,..., — 1 if, and only if, ([^ is 

positive when i = 1. When z = 1, ([§ equals [(A^ - 1)(P - 5) + (T - P)]/A^, which 
is positive if, and only if, N < {S — P + T — P)/{S — P). 


• If P > S and T < P, the term P —S in ([^ is positive, and the term T — P is negative. 
The expression ([^ is therefore decreasing in x := i/N, and therefore smallest when 
z = {N — 1)/A^. So, in this case, > 0 for each z = 1,..., A^ — 1 if, and only 

if, (§ is positive when z = {N — 1)/A^. When z = {N — 1)/A^, © equals [(P — S) -|- 
{N — 1)(T — P)]/A^, which is positive if, and only if, N < {R — S + P — T)/{P — T). 
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